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ABSTRACT 

The purpose of this study was to measure the attention of 
deaf children to captioned visuals using a conjugate reinforcement 
procedure. The subjects were six deaf children, aged eight to 
fifteen, whose IQ's fell within the normal range. The stimulus 
material consisted of slides produced from a captioned filmstrip. 
The presence of the stimulus was contingent on a pressing response 
from the S. The study failed to produce any significant results 
vis-a-vis captioned vs. non-captioned visuals and optimal words 
per minute for presentation. The author attributes this failure 
to the small sajnple tested, and recommends replication of the study 
with a larger sample and minor modifications. 
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SPECIAL REPORT No. 7318 
COMPUTER-BASED PROJECT for the EVALUATION 
of MEDIA for the HANDICAPPED 

T i t I 9 I THE USE OF REINFORCEMENT PROCEDURES TO MEASURE 

ATTENTION TO VISUALS AND CAPTIONS WITH DEAF SUBJECTS 

BACKGROUND gy . Ronald E. Nomeland 

The Computer Based Project for the Evciluation of Media for the Handicapped, 
based on contract }fOEC--D-423617*4357 (616) between the Syracuse (N,YJ City School 
District and the Media Services and Captioned Films Branch, Bureau of Education 
for the Handicapped (United States Office of Education) for the five year period 
July 1, 1969 through June 30, 1974. The major goal is to improve the instruction 
of handicapped children through the development and use of an evaluation system 
to measure the instructional effectiveness of films and other materials with 
educable mentally handicapped (EMH) children, in-service training and media support 
for special teachers, and studies related to the evaluation process and the 
populations used. 

The Project has concentrated on the 600 films and 200 films trips from the 
Media Services and Captioned Films (BEH - USOE) depository; however, specific 
packages from Project LIFE, various elementary math curricula, and selected 
programs from Children's TV Workshop have also been evaluated. The ^valuation 
model used requires that: 1) objectives of materials be specified and written; 

2) instruments be constructed to test and measure effectiveness; andr 3) children 
be the major sources of evaluation information. A number of instruments and 
methodologies are employed in the gathering of cognitive and affective data from 
900 EMH children and 80 special teachers to make the effectiveness decisions. 
Over half of the EMH population can neither read or write; therefore, a unique 
Stu'lent Response System (SRS) is employed, consisting of a twenty station G.E.- 
1000 SRS which can be operated in a group or individual recording mode and is 
connected to a remote computer system. The computer capabilities consist of 
remote telephone connections to the Rome (N.Y.) Air Development Command, the 
Honeywell time-shared network, and the Schenectady (N.Y.) G E Research and 
Development Center; and batch mode capabilities of the Syracuse City Schools, 
Syracuse University, and varioas commercial sources. 

In-service and media support activities provide on-the-job training for 
teachers, teacher aides, equipment, and materials to the special teachers in 
the city schools. The research activities have centered around Investigations 
and special problems related to the development of the evaluation model. The 
four major areas considered are: 1) testing effects, 2) captioning effects, 

3) special student characteristics; and, 4) evaluation procedures validation. 

Documentation of the major activities appear in the five annual reports 
and the 600 evaluations prepared on materials used. Staff m'anbers v/ere encouraged 
to prepare special reports and the attached paper is one of these. The opinions 
expressed in this publication do not necessarily reflect the position or policy 
of the Computer Based Project, the United States office of Education, or the 
Syracuse City School District, and no official endorsement by any of the agencies 
should be inferred. 
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THE USE OF REINFORCEMENT PROCEDURES 
TO MEASURE ATTENTION TO VISUALS AND CAPTIONS WITH DEAF SUBJECTS 

Several research studies (Fischer, 1971> Mix, 1971; Davila, 1972; 
Nomeland, 1973) have indicated that captioned films and slides, as 
produced for deaf learners, contribute to higlier performonce than non- 
captioned versions. Investigations employing captioned videotape 
(Gates, 1970; Propp, 1972) also suggested the positive effects of cap- 
tioned verbal matter over other forms of communication such as lip 
reading and manual signs for deaf learners. Ail of these studies were 
concerned with the overall effect of the presentations as measured by 
posttests which were administered after treatments. 

Notes (1972) emphasize that a caption should stay on the screen 
long enough to be read by the audience, b ut short enough in duration 
so not to obscure the picture' (p, 1). Hence, the captions fn education 
al films are geared to a reading speed of approximately 120 words per 
minute. 

The present study was an attempt to; (l) measure the attending 
behavior of the S^s toward still visuals, either with or without captions 
and (2) measure the attending behavior toward the captions. The 
questions to be answered were: (1) Is there o difference in attending 
to the visuals with captions and those without captions?; (2) Is the 
presentation of the captions at the rate of 120 wpm adequate?; (3) 
Are there other variables, such as age and achievement reading level, 
which affect attention to the captions? 



The study employed the conjugate reinforcement procedure using 
slides as stimulus material. 

The paper provides an Introduction to the problem, followed by 
a background and description of conjugate reinforcement. Then the 
experimental procedure is described. Finally, the results, discussion, 
and conclusions are presented, 

Background 

The conjugate reinforcement procedure is based on Skinner's (1953) 
operant psychology in behavioral science. In pointing out that any 
emitted response v/hich leads to reinforcement has a higher probability 
of re-occurrence than a non-reinforced response Skinner implies that 
operant conditioning can be employed to enhance learning in instruc- 
tional situations. 

In a typical operant conditioning study, a specific response such 
as bar pressing or key pecking Is reinforced by rewarding the S^with a 
reinforcer, such as food or candy. It has been observed (Holland & 
Skinner, I9^'l) that a S^, i.e. a pigeon, on being reinforced with food 
after emitting a response, tends to continue pecking as long as its 
responses are reinforced. 

Conjugate reinforcement is an outgrowth of Skinner's basic operant 
conditioning technique., Instead of using food, the presence of the 
stimulus itself serves as a reinforcer. The conjugate reinforcement 
procedure was developed following studies by Baer (19^^!D) and Llndsley 
(1962) which shov/ed that S^s would respond to maintain the presence of 
pictures; thus, pictures were said to liavc reinforc Ing value. 
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A previous study on conjugate reinforcement with captioned slides 
was conducted by Richard Lewis (1973) at Computer Based Project in 
Syracuse with 18 hearing third-graders* The stimulus materials con- 
sisted of the individual frames from a IS^frame color filmstrip '^Uew 
Quarters Are Made and the captions from the filmstrip which were re- 
produced on a separate ^^et of slides, Sound was not used in the study. 

The experiment was set up so that the visuals were projected 
continuously for ten seconds each; however, the presentations of the 
captions were controlled by the S^s who would press the microswitch 
in order to produce the captions on the screen. Thus the visuals 
were constant and the captions, contingent on bar pressing, were the 
experimental var tables. 

Lewis concluded that the Ss attended to the captions In differ- 
ent ways. Some would watch the visuals before attending to the 
captions; conversely, others desired the captions immediately with each 
new visual. Some would maintain the presence of the captions through- 
out the presentation of the visual v;hile others would watch the captions 
only for a few seconds* Attending behavior was also affected by the 
length of the captions. 

Based on Lewis^ findings, the present study was modified to control 
for the variability in the presentation of the captions; this v/as 
accomplished by including the captions on the visuals. 



Method 

Subjects . S^s v;ere six students from Rome and St. Mary^s schools 
for the deaf who reside in the Syracuse area. AH the Ss selected 
for the study were between the ages of eight and fifteen and possessed 
an Intelligence quotient within the normal range (85-115). The 
achievement grade level for the reading subtest, as measured by Stanford 
Achievement Test, ranged from 1.6 to 3-1 and the battery median from 
grade level 1.6 to ^.6. During the training session, each £ spent 
about five minutes In the experimental chamber and was able to operate 
the response button. 

St imulus Material . A ^8-frame color filmstrip, ^'The Brave Little 
Tailor , copied on 35nnri slides, was employed in the study. Each slide 
contained either no caption, or a one-line, two-lrne, or three-line 
caption. It was assumed that the visual attractiveness (color, form, 
content) v/as randomly distributed througliout the presentation. The 
slides were projected by a Kodak Carousel projector without audio 
soundtrack. 

App aratus . The experiment was cojiducted in a sound-attenuated 
enclosed chamber, measuring 6 x8'x8'. The enclosure was divided into 
two sections with a U xlA rear projection screen mounted on the 
dividing wall. The S^s section measured 'ii'x6i and was illuminated 
by two fluorescent fixtures on the dividing v;all. The room was equip- 
ped with a chair facing the rear screen. The stimulus material was 
presented on the screen which was at eye level of the when sitting, 
and approximately three feet from the S*$ head. A mtcroswitch was 
housed In the right arm of the chair* 



Programming and recording equipment were located In the Vs 
section measuring 3^x6'. The programming equipment Included a Coxco 
cassette tape recorder v-zhich advanced the slides by inaudible Im* 
pulses and recorded the sMde changes on the Harvard cumulative 
recorder. The slides were projected on a mirror which reflected the 
Image on the rear screen. A visual conjugate reinforcer (VCR) was 
also housed in the E's section. The VCR was programmed so that each 
button press produced the stimulus for one-half of a second. 

SUd^ changes and responses v^ere recorded on a Harvard Cumulative 
Recorder Model C-3. The paper speed was set at Icm/10 seconds > or 
6cm/mi nute. 

Procedure . Each of the 48 slides was projected for ten seconds , 
totaling eight minutes of projection time. Each new slide was initially 
presented for one second, and v/lthdrawn. The presence of the visual 
during the last nine seconds v/as thus contingent on the pressing of the 
microswitch. Each press presented the slide for half a second; there- 
fore, In order to maintain the presence of tlie visual throughout each 
ten-second Interval the S had to respond at least 10 times. 

S^s were brought to the enclosure and told it was a viev/lng roo^n. 
The E^ asked the to sit down and look at the screen. The E^ then ex- 
plained to the that he would show some pictures, and that they 
v/ould fade out after a v/hlle. The £ then said, If you want to see the 
picture again, you must push the button, let go, and push again, like 
this^\ The pressing was demonstrated and the S had an opportunity to 
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practice It during a series of 15 training slides. The S was also 
promised some candy upon finishing the experiment. 

Ana l ys I s , Data were collected from the responses on 20 slides of 
which ten slides were uncaptioned, five slides contained two lines of 
caption, and five slides contained three lines of caption. These 
slides were selected randomly, with the exception of the film ccntaln- 
Ing three lines as there were only five in the presentation; all of 
them were included in data analyses. None of the first eight slides 
were included in the analyses; they permitted further practice under 
actual experimental conditions after the training session. 

Responses for each of the 20 slides, as recorded on the cumulative 
recorder » were counted • A simple analysis of variance was performed 
to investigate the differences In attending behavior toward the three 
groups of visuals. The Pearson Product Moment Correlation coefficient 
was computed to indicate the relationship between the dependent variables 
and the student characteristics. 

Re su 1 ts . Data were collected from six Ss; however; the results of 
the last four S^were included In the final analyses. The record of 
the first tv/o S^s Is shov/n in Figure I, Subject Y was instructed to press 

Insert figure 1 here 

the microswitch as long as he wished to attend to the visual, and to 
advance tiie slides by pressing another but ton. However, the figure shows 



that he pressed the mlcroswltch at an average of three times (total 
123 presses) before changing the slides, and that he spent an average 
of five seconds for each visual, totaling ^:06 minutes for the total 
presentation. 

The procedure \vas revised for the second £ so that each slide 
was available at a fixed interval for ten seconds each. However, 
Figure 1 (Points D) shows that Subject Z would emit some responses for 
a while before pausing. Then the would press the switch again. This 
pattern seemed to indicate that the S_ wa:> pressing to find out if the 
slides had been already advanced or not. Because of this unexpected 
behavior the procedure was again modified. As a result, each nev; 
visual v/as presented for the first second to inform the S^s of the new 
visual, and then withdrawn. 

The responses emitted by each of the remaining four Ss are 
recorded in Table I which show the mean number of presses for each of 



TABLE I 

AVERAGE NUMBER OF RESPONSES FOR EACH SLIDE 



Subject 


Visuals wi th captions 


Visuals without captions 


A 


20. k 


21 .0 


B 


22.8 


20.6 


C 


31.0 


30.2 


D 







the ten captioned visuals and ten uncaptioned visuals. It is noted 
tliat Ss 3 and C attended to the captioned visuals longer than those 
without captions; conversely, A and D responded higher to the un- 
capt toned si ides . 

Table 2 shows a IF of .0090, indicating no significant difference 

TABLE 2 

SUMMARY TABLE-AtlALYSIS OF VARIAIICE 



Source 


Sum of Squares 


df 


Mean Square 




Between groups 


.25 


J 


.25 


,0090 


Within groups 


166.27 


6 


27.71 





in means of responding between the captioned and uncaptioned slides. 
Table 3 records the mean number of responses emitted by each ^ 



TABLE 3 

AVERAGE NUMBER OF RESPONSES FOR EACH SLIDE 



Subject 


' ■ ' ' > 

Visuals with 
3-1 i ne capt Ions 


Visuals with 
2-1 Ine capt fons 


Visuals without 
capt ions 


A 


13.2 


21.6 


21 .0 


6 


23.2 • 


22. if 


20.6 


C 


30.0 


32.0 


30.2 


D 


23.2 


13.6 


19. i; 



for five slides each of the three-and two-line captions, and ten un- 
captioned slides. The data shows tliat £s B and D maintained the three- 
line captions longer than the two-Iine captions, but D attended to 
the uncapt ioned si ides longer than to the two-line captions. 

The summary table of analysis of variance, shown in Table ^, 
Indicates a pf /OS^S* The result suggests no significant difference 



TAQLE ^ 

SUMMARY TABLE—ANALYSIS OF VARIANCE 



Source Sum of 


Squares 




Mean Square 


F 


Between groups 


^♦.83 


2 




.05'»9 


Within groups 


39'*. 52 


9 


^♦3.83 





in attending to the different lengths of captions. Thus, It cannot be 
determined If the presentation of the captions at the rate of 120 wpm 
Is adequate. 

Inasmuch as the data on only four S_s were collected, the data for 
the third quest ion-'-are there other variables, such as age and achieve- 
ment reading levels which affect attention to the capt ions--was not 
analyzed . 
Disc us s ion 

The study failed to produce any significant findings; this might 
be attributed to a small number of Ss available for the study. 
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However^ If the raw data ts representative, It Is questionable If a 
larger sample would produce a significant difference* 

The fact that the study t'as conducted during the surmier^ and in 
an atmosphere unfamiliar to the £s> might have a bearing on the results. 

It is probable that the eight-minute presentation with ^8 slides 
was too much for the S> but all S^s maintained switch pressing at 
approximately the same rate throughout presentation. 

Cone 1 us i ons 

Although the study failed to produce any significant findings, it 
is believed that the study Is worth pursuing. It Is suggested that in 
further studies the ^-second presentation of the stimulus for each 
switch press be reduced to one-third or one-fourth of a second in order 
to produce a more sensitive measurement of attending behavior. 

In retrospect It Is the opinion of the £ that the first procedure, 
which allows for the $_ to advance the slides himself, was discarded too 
hastily, Tlie S v/as less than ten years old; therefore, his behavior 
should not be generalized to an older learner*. It is believed that 
this procedure should be attempted again. It is also suggested that a 
further experiment which would allow the ^ to either advance or to go 
back to a previous slide be tried. 
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Subjoot V Subjeot Z 



Re spen ds O S 



Figure t. The response records of two S^s. Points labeled A indicate 
wher the slides were advanced. Response's emitted are Indicated by 
3 and a pause In responding Is indicated by C, 
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TABLE I 

AVERAGE NUMBER OF RESPONSES FOR EACH SLIDE 



Subject 


Visuals with captions 


Visuals without captions 


A 


20.^* 


21.0 


B 


22.8 


20.6 


C 




30,2 


D 


18. 





TABLE 2 

SWIMARY TABLE— ANALYSIS OF VARIANCE 



Source 


Sum of Squares 


df 


Mean Square 


F 


Between groups 


.25 


1 


.25 


.0090 


Within e^^oups 


166.27 


6 


27.71 





TABLE 3 

AVERAGE NUMBER OF RESPONSES FOR EACH SLIDE 





Subject 


Visuals with 
3-lln6 captions 


Visuals with 
2-line captions 


Visuals without 
captions 




A 


19.2 


21.6 


21.0 




B 


23.2 


22. if 


20.6 




0 


30.0 


32.0 


30,2 




D 


23.2 


13.6 


19.^ 



TABLE k 

SWIMARY TABLE— ANALYSIS OF VARIANCE 



Source 


Sum of Squares 


df 


Mean Square 


r 


BetKeen groups 


't.83 


Z 


2.1+1 


.05lf9 


Within groups 


39'*.^2 


9 


1*3.83 
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